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Deducing the Asymptotic Behavior of a Function 
from Its Behavior on a Subsequence 

Daniel Dari* and Harts nt Huber 



Abstract 

This peeper investigates the relations between two 
complexity functions when they have the same order 
class on a subsequence. Sufficient conditions are derived 
for concluding that two functions have the same order 
class if they are sufficiently related on a subsequence. 
These theoretical results are used to prove order class 
properties of complexity functions arising from divide 
and conquer problems. In addition, it is shown that 
between any two comparable non-constant order classes 
there are order classes that are incomparable. 



1. Introduction 



The typical approach to determining the asymptotic complexity of a 
divide and conquer algorithm is to develop a recurrence relation on a 
subsequence of the domain of the complexity function, solve this 
recurrence, obtain the asymptotic complexity of the subsequence function 
and use this to deduce the asymptotic complexity of the function itself. 
In this paper, we closely examine the conditions that justify this last step. 
More precisely, under what conditions can we conclude that two 
complexity functions have the same order class, given that on some 
infinite subsequence, they have the same asymptotic complexity? 

In section two we develop the primary results. In particular, we 
develop several sufficient conditions for concluding that two functions are 
comparable, given that they are comparable on a subsequence. If the 
order class of a function f is determined by the values of f on a sequence 
t then t is called a test sequence for f. Sufficient conditions are derived 
for defining coarser test sequences from a given test sequence. In the 
third section we examine some examples and apply our theoretical 
results to recurrence relations arising fron divide and conquer problems. 
In the fourth section we show that between any two comparable 
functions there are incomparable functions. 

In the original work on this problem, we used standard methods. 
Gradually, it became evident that there was an inner structure 
underlying our results, and we found that our major results could be 
proved almost trivially using the concept of generalized inverses. The 
following is therefore of as much interest for the use of this concept as for 
the final results. 

2. Primary Results 

In the following, we will use the notation N for the nonegative 
integers, R for the real numbers. For relations and functions we use the 
following notation: c for asymptotic dominance, « for strict asymptotic 
dominance, » for asymptotic equivalence and 1 for the identity function 
on H. Also we use the notation s^JI -* H for the "k - shift" function 

defined by s^(n) = n + k. All functions are assumed to be monotonically 

increasing. When a function is strictly increasing, this will be stated 
where necessary. Throughout the following we will use the term "order 
class" to mean an equivalence class of the relation a. 
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A sequence of nonnegative integers is described by a strictly 
increasing function t H -> H. Such functions do not, in general, possess an 
inverse , but they always possess generalized inverses 111. In fact, we 
have the following: 

Lemma 2. 1. If t M -> M is a strictly increasing function, then t has a 
unique generalized inverse t*~ Jl -> H such that: 
t®t*" s 1 and t 4 " ®t» 1. 

Proof : Define f" by t^Cn) * m if and only if m is an integer such that 
Um) < n < Um + 1). Such an m clearly exists. Then we have t® t*"(n) i n < 
t o s 1 ®t^(n). Also, it is easy to check that t® t* - ® t* tand t*"® t® t*~ = t*~. 

If t is strictly increasing then m is unique, and if n = Um), then U"(m) = n. 
Thus U"(Un)) ■ n. 



Lemma 2.2. If t IV -> H is a strictly increasing function, then t has a 
unique generalized inverse £* * -* H such that 
tot - " i 1 and r*®t- 1. 

Proof : Define t* by t“*(n) - m if and only if m is an integer such that 
Um - 1) < n i Urn). Such an m clearly exists. Then we have t ® s_ j® t“^(n) < 

n i t® fUn). Also, it is easy to check that t ® t~*® t - tand tr*® t® f 4 - V*. 
If t is strictly increasing then m is unique, and if n - Um), then t"Um) - n. 
Thus t*"(Un)) * n if t is strictly increasing. 

Associated with each sequence t are two difference functions and A^. 
defined as follows: 

Definition: If t N -» N is a strictly increasing function, define the 
iower difference function H -» H , and upper difference 

function A^.: H -> H by: 

» t ® t*“ and A^ = t • £* 
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Lemma 2 .3 Given a strictly increasing function t: H -+ If, the functions 
and have the following properties: 

1. 1 and 1 < ^ 

2. &t«t>tandAt«t>t Geft neutral relative to t) 

3- 0 *t " h 311(1 *t 0 *t " *t 

Proof: Straightforward. 

The following theorem is the first important result 



Theorem 2.1. Consider two functions i, g: M -> I, and assume that 
there exists a strictly increasing function t M -> M such that 

*°V f 

then 

f *t c g ® t iff fcg. 

Proof : The relation c is right invariant under composition. Thus, 
f « f ® * f 0 1 o t^“ c g • t * t*“ ■ g • ^ i g 



Corollary 2.1.1. If f, g: M -* R are two functions and t: M -> IV is a 
strictly increasing function, such that: 

f**t>f, g*vg, 

then 



f ot»go t iff f>g. 



Also, the result that f ® « f is a property of an order class follows 

from invariance of the relation * under right composition and the above 
theorem. 



Corollary 2.1.2. - If f, g: M -> R and fag, then 
f® ^ ■ f iff g • ^ * g. 

Theorem 2.2. Consider two functions f, g: H -> R, and assume that 
there exists a strictly increasing function t: H -> W such that 

g*V g 

then 

f • t c g • t iff fcg. 
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Proof : The relation c is right invariant under composition. Thus, 

a f*At»f®t* f*C g • t • t -4 « g • A^ ■ g 



Of course, we have analogous corollaries. 



Corollary 2.2. 1 If f, g: X -♦ R are two functions and t H -» H is a 
strictly increasing function, such that 

*°V f ' S°V& 



then 



f*t«g*t iff f*g. 



Also, the result that g « ■ g is a property of an order class follows 

from invariance of the relation a under right composition and the above 
theorem. 

Corollary 2.2.2. - If f, g: H -► R and fag, then 
goA^ag iff foA^af. 

There are some additional properties of the generalized inverses of 
the functions that define test sequences that can be used to find 
additional, coarser test sequences. 

Lemma 2.4. If s,t H -> X are strictly increasing, then 
(sotr-f. s 4- and (s • t)" 4 - f 4 • s"V 

Proof : Both parts of the proof are similar so we do only one. 

From s*~ »s - 1 and t 4 " ® t - 1, it follows that t 4- • s 4 "* s ® t - 1. 
Similarly, from s • s 4- si, and t • t 4 " s 1 , it follows that 
s® tot 4- os 4- i s*s*~ i 1. 

Thus, t 4- • s 4 " has the unique defining properties of (s « t) 4 *- 

Note that the sequence defined by uJI X is a subsequence of the 
sequence defined by s: N -► N, if there exists a sequence tJI -► X, such that 
u =s®t. 
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Theorem 2.3. Let s, t: N -> H, be strictly increasing and f: N -> R 
If 

f • b s * f and (f^s)*^*^, 

then 

f°*sot Bf - 

Proof : f • = f«S*t«(S® t) 4 ” af^Sotot^oS^-f^SoS^Sfo^gSf. 



In essence this theorem states that if s is a test function for the order 
class of f and t is a test function for the order class defined by g • f • s, 
then s « t is also a test function for f . Of course, s • t is a subsequence of s 
and therefore is a ‘coarser’ test sequence than s. An analogous result 
holds for the upper difference function A^. 



Theorem 2.4. Let s, 1 1 •+ M, be strictly increasing and fJf -» R. 

If 

f • Ag ■ f and (f^s^A^f^s, 

then 

f°Asot sf - 

Proof , f •Ag 0 ^ *f°s°t°(s® t)"* ■f®S®t°t” > °S" 4 «f®S®S' 49 f*Ag 9 f. 



3. Examples and Applications 

We call the condition f • ^ * f the lowor growth condition of f for t 

and f • A t * f the upper growth condition. Corollary 1.1.1 and Corollary 

1.2.1 say that any two functions ijg that satisfy a growth condition for t 
and are equivalent on t have the same order class. Thus, if f satisfies a 
growth condition for the sequence t then the order cla s s of f on t 
determines the order class of f uniquely. 

Example 3-1: The growth conditions of f for t are the weakest 
conditions that allow us to conclude fcg if f • t c g*t Thus, if f • ^ 

f f then one can find a gH -> R such that f • t c g • t but f <f. g. Obviously, 
g - f • is such a function since got-fotot 4 ” • t - f • t d f • t but g - 

f • ^ * f. 

Similarly, if g • A^ ^ g then f = g • A^ satisfies g*t = f«tDf*t but 
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f = g« At tg. 



Example 3.2: The condition f <> t <> Sj = f » t is stronger than the 

growth condition of f for t and need not he satisfied even though f • * f, 

f o t c g • t and hence f c g. For example, let g: H -> R, t: N -> H be such 
that g • t«Sj^ g • t and define f: M -> N by f - g • Then f • ^ - g • 

s t oi t ss 8 oi t = ^ fot = 8 ot < : g ot 30(1 leg but f°t«Sj t f • t 

Example 3-3: The two conditions f « ^ * f and f • A^ * f are not 
equivalent. They are, in fact, independent conditions. Let g: II -> R be such 
that g • f* g • 3111(1 de ^ e * ^2 - * _> * * 1 * g 0 h> *2 * 8 ° k* 

f i • *t 8 f i butfpA^fj and 

f 2 ° k Bf 2 but h 0 h^h- 

3-1 Bounding functions for ^ and A^ ; It follows from the 
definitions of ^ and that the function Lj. = t <> s_ j <> t~* is a lower bound 
for ^ and that U t »t<>Sjot*"isan upper bound for A^. Thus, ^ and At 
can be bounded as follows: 

L t iS t HiA t sV t 

1^ and U t are step functions that satisfy the conditions 
Lt° u t“ 6 t Lt*u t *t-t 
u t oL t -A t 

The following two lemmas establish the relationships between the 
growth conditions of f for t and similar conditions using 1^ and U t instead 

of and A^. 

Lemma 3.1. If f* ->R then f • I^af iff f«U t >f. 

Proof: If f c f • 1^ then f •U t cI«L t *U t =f*^cf, hence f • U t = f . 
Similarly, if f d f • U t then f^I^DfoU^oI^ » f * A^ z> f, hence f • * f . 

Lemma 3-2- If f • I^af then f °6 t »f and f • A^af. 
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Proof: If f c f • then f <> A^ c f oL^oA^sfoL^cf, hence f « a^ = f. 
Also, if f c f • Lj. then f d f « and fo^DfoU^o^.=foUj_Df, hence 
f ®$t 3 f. 

It should be noted, however, that the two conditions f»^»f together 
with f o Aj. 3 f are not equivalent to f • s f (or f ® U t * f ). For example, if 
t * 1, then the function f (n) * a 2 ** 11 does not satisfy f • 1^ a f since with 
I-t = s_p f ° Lj(n) * f(n-l) = a 2**(n-l) ^ a a 2 ** 11 = (a 2 **k-l))2 

f o £t = f and f o At = f hold. If, on the other hand, t is such that t(n+ 1) > 
t(n) + 1 for all n * N 0 for some then fo^DfDfoA^ implies f • 1^ d f 

DfoU t . 

The values of 1^ and U t on the sequence t are defined by the 
equations: 

LjfUn)) = t(n-l) 

U t (t(n)) « t(n+ 1). 

Since L t «U t -U t *L t - Ion Un), each of these equations is equivalent 

to the other one and represents the recurrence relation that defines the 
sequence t(n). Lj. expresses t(n) as a function of Un+l), U t expresses 

t(n+ 1) as a function of Un), On the sequence t , Lj. and Uj. are inverses of 

each other. 

Any monotonic function L such that L ° t » I^.<> t is a lower bound for 
and any monotonic function U such that u • t ■ • t is an upper 

bound for A^. Such bounding functions L, U can easily be computed for a 
sequence that is defined by a recurrence relation between Un) and t(n+l). 

For example, let t be defined by UO) * b, Un+ 1) * bt(n) then U * b I 
and L * 1/b. Or, to give a less trivial example, let t be defined by UO) = b, 
Un+l)*Un) 2 . In this case, L(n) «/n and U(n)*n 2 . 

3.2 Divide and Conquer Problems: Our theoretical results can be 
used for proving order class properties of complexity functions arising 
from divide and conquer problems. For example, a result of two 
theorems (5 3 3 and 5 3.4) in 12) is that the order class of a monotonic 
function f that satisfies the recurrence relation: 
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f( 1) * c 

f(n) = af(n/b) + cn 

on the sequence t(k) = b k is uniquely determined by the values of f 
on t This result is proved by solving the recurrence relation, analyzing 
the solutions which have different forms depending on the relative size of 
the constants a, b, c, and establishing that in each case the growth of the 
solution is compatible with the growth of the sequence t to guarantee the 
unique order class of f. This is an unnecessarily complicated method for 
establishing a result that follows directly from the recurrence relation. 
Intuitively, one would expect this since the recurrence relation expresses 
directly the local growth property of f in relation to the growth of t that 
allows us to make conclusions about the order class of f. Our method 
applied to a more general problem is described below. 

Theorem 3.2.1: Let f, h, a JV -> R, where a is bounded, and g H -> H 
be such that f satisfies 
f(0) « c 0 

f(n) » a(n)f(g(n)) + h(n) 

on the sequence n = tfk), k* 0 where Uk) is defined by 
t(0) * a 0 

g(t(k)) = t(k-l). 

Ifh°tch°tos_i then the order class of f is uniquely determined 
by the values of f on t 

Proof : Consider the recurrence relation for f on t 
f •t-a*f»t*s_j + h*t 

= a*a*s_j<>f<»t<> s _2 + a*h<> t*s_j + h*t 
c a * (a ® s_ j® f • t • s _2 + h ® t ® s_ j) 
»a*f<>t*s_jCf<>t*s_ 1 

Hence f c f • = f • t* t - * c f • t<> s_ j • t - * = f <> 1^ c f ® By Corollary 

2.2. 1 the condition f = f ® ^ determines the order class of f uniquely. 

For example, h(n) « cn, a(n) - a, and g(n) - n/b define the classical case 
of a complexity function arising from a divide and conquer problem with a 
linear overhead. Here t(k) - b* and the condition h*tch*t*s.j holds 

since b k c b^' 1 = b^/b. 

More generally, the condition h«tchot<>s_j is satisfied for the same 
sequence t * b* if h is any polynomial in n. However, if g(n) = /n, defining 
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the sequence t(n) = b 2 ** 11 , the condition h«tch°t*s_i does not hold for 

a linear or polynomial function h(n). It holds for h(n) - constant In fact, 
since for h(n) - constant the condition h«tch<>t<>s_i holds for any t, it is 

clear that in this case the values of f on any arbitrary sequence determine 
the order class of f uniquely. 

4. Incomparable Order Classes 

In this section we construct examples that demonstrate that, in 
general, no relationship concerning the order classes of two monotonic 
functions is determined by the fact that the functions coincide on an 
infinite subset of their domain. This is trivial if the functions are not 
required to be monotonic but it is not obvious for monotonic functions. As 
in the previous sections, all functions are assumed to be monotonically 
increasing. For the construction of the examples the following lemma and 
its corollary are needed. 

Lemma 4.1: For any f, g: H -> R the following statements are 
equivalent: 

(1) gtff 

(2) there exists a sequence S of integers such that for every infinite 
subsequence {fij | nj « S, i * 0, 1,...} the sequence gtap/ftop is strictly 

increasing and unbounded. 

Proof : 

1. Assume that g £ f. Then there exists a sequence S j such that the 
sequence gfmp/ffmj) is unbounded for m^ in S j * (m j, m 2 , ... ). Select from 
S i a subsequence S = (n j,n 2 ,...) such that for each nj in S 

g(nj + jJ/ffoj* j ) >. g(nj)/f(nj) + r 

for a fixed real number r. This can always be achieved since the 
original sequence gfmp/ffmp was unbounded. In addition, every infinite 

subsequence S’ of S has the property that the sequence 
gfciVfOtj), kj in S’ 

is strictly increasing and unbounded. 

2. Conversely, assume that S - (n |,n 2 ,...) is a sequence of integers such 

that for i = 1 , 2 ,... 

gtajl/ffop, i^inS, 

is unbounded. Then, a fortiori, for no constant K in R, the relation 
g(n) < Kf (n) can hold for all but finite many values of n. Hence g <£ f. 
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Corollary 4.1: For any f,g. H -> R, let S be a sequence of integers 
such that g(nj)/f(nj) is strictly increasing and unbounded for every 

subsequnce (n |,n 2 ,...,n|,...) of S and let h: H -> R. Then, 

h t f if h(n) = g(n) for an infinite subsequence of S and 
h 2 g if h(n) = f(n) for an infinite subsequence of S. 

Construction of the examples: 

Let f,g: H -> R, f « g, and f » const We will first construct a function h 
such that f « h « g . This can be accomplished by splicing pieces of f and g 
and constant functions together. From h one can then construct two 
functions h j and h 2 that are not comparable. This situation is characterized 

by the condition: h j ^ h 2 and h j i h 2 . The details of this construction are 

shown below. 

Since f « g there exists an integer N f and a real number K such that 
f(n) < Kg(n) for all n >. N f Also, since g <L f there exists a sequence S of 
integers as described in lemma 4. 1 . 

(a) Define the following sequence of integers Nj, j i o: 

K 0 .N, 

For i i 0: 

N^j » smallest integer It: It > N^and It in S 
N^ 2 « smallest integer k: k > and f(k) > Kg(N^ 

* smallest integer k: k > N^ 2 and k in S 

(b) Define h:N -> R as follows: 

h(n) « f(n) for n s N 0 

h(n) = Kg(n) for N J1 <n 

h(n) * Kg(Nj^j) for < n < 
h(n) - f(n) for N^ 2 * n * 

By construction, it follows that 

(1) f(n) i h(n) s Kg(n), hence f c h c g. 

(2) h(n) = Kg(n) on an infinite subset of S, hence h t f. 

(3) h(n) = f(n) on an infinite subset of S, hence h ? g. 

Therefore, f « h « g. 
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(c) Define hj, h 2 JI -> R as follows: 
hjfo) = f(n) for < n < 
h j(n) * h(n) elsewhere 

h 2 (n) = f(n) for < n < 
h 2 (n) = h(n) elsewhere. 

Since h j(n) = Kg(n) for all values of n from an infinite subset of S, it 
follows from the corollary that hj i f. From f c h 2 we obtain hj <£ h 2 . 
Similarly, since h j(n) - f(n) for all values of n from an infinite subset of S, 
it follows from the corollary that g t h v From h 2 c g we obtain h 2 { h j. 
Therefore, none of the order class relations «, », e hold between h j and 
h 2 . These two functions are not comparable. 

Thus, the concept ’order class’ does not characterize the asymptotic 
behavior of monotonic functions very well. It only classifies functions 
according to one single growth characteristic represented by the growth 
of the bounding function, bounding from above. The examples show that 
the growth of functions can flip between the growth characteristics of 
different order classes. Thus, while the order class concept provides a 
means for equivalencing monotonic functions and therefore partitioning 
the set of monotonic functions, it does not provide a means for ordering 
the resulting classes. 

5. Conclusion 

The results of the last section confirm the intuition that asymptotic 
complexity can be a poor means for comparing algorithms. In general, 
there is no asymptotic limit that reveals the true growth of an algorithm. 
Indeed, functions can behave more erratically in their limit than on any 
finite interval. Similarly, the notion that the asymptotic behavior of a 
function on an infinite subset of the domain should allow us to infer 
asymptotic behavior is false. Combining these results with the fact that, in 
general, we are interested in the behavior of algorithms on problems 
within a range of sizes, not in asymptotic behavior, we see the need for 
better, more useful methods for analyzing and comparing algorithms. 

For some important classes of problems, however, we know that the 
complexity functions are sufficiently well behaved that their asymptotic 
growth reflects the true growth of the corresponding algorithms. The 



growth conditions developed above characterize precisely the meaning of 
the intuitive idea of a function being well behaved. In addition, these 
conditions provide a simple, yet powerful proof technique for inferring 
the overall growth behavior of a function from its growth behavior on a 
subset of the domain. 
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